The performance increase comes from driving all your accessories slower. The mass of the actual pulley is tiny compared to the mass/resistance of all the accessories it is turning.
If you make your accessory pullies larger to compensate for the underdrive pulley, that would work but you'd lose some of the performance benefit since you're driving some of the accessories faster again.